BCI Competition IV – Data Set I: Learning Discriminative Patterns for Self-Paced EEG-Based Motor Imagery Detection

Detecting motor imagery activities versus non-control in brain signals is the basis of self-paced brain-computer interfaces (BCIs), but also poses a considerable challenge to signal processing due to the complex and non-stationary characteristics of motor imagery as well as non-control. This paper presents a self-paced BCI based on a robust learning mechanism that extracts and selects spatio-spectral features for differentiating multiple EEG classes. It also employs a non-linear regression and post-processing technique for predicting the time-series of class labels from the spatio-spectral features. The method was validated in the BCI Competition IV on Dataset I where it produced the lowest prediction error of class labels continuously. This report also presents and discusses analysis of the method using the competition data set

Filter Bank Common Spatial Pattern Algorithm on BCI Competition IV Datasets 2a and 2b

The Common Spatial Pattern (CSP) algorithm is an effective and popular method for classifying 2-class motor imagery electroencephalogram (EEG) data, but its effectiveness depends on the subject-specific frequency band. This paper presents the Filter Bank Common Spatial Pattern (FBCSP) algorithm to optimize the subject-specific frequency band for CSP on Datasets 2a and 2b of the Brain-Computer Interface (BCI) Competition IV. Dataset 2a comprised 4 classes of 22 channels EEG data from 9 subjects, and Dataset 2b comprised 2 classes of 3 bipolar channels EEG data from 9 subjects. Multi-class extensions to FBCSP are also presented to handle the 4-class EEG data in Dataset 2a, namely, Divide-and-Conquer (DC), Pair-Wise (PW), and One-Versus-Rest (OVR) approaches. Two feature selection algorithms are also presented to select discriminative CSP features on Dataset 2b, namely, the Mutual Information-based Best Individual Feature (MIBIF) algorithm, and the Mutual Information-based Rough Set Reduction (MIRSR) algorithm. The single-trial classification accuracies were presented using 10 × 10-fold cross-validations on the training data and session-to-session transfer on the evaluation data from both datasets. Disclosure of the test data labels after the BCI Competition IV showed that the FBCSP algorithm performed relatively the best among the other submitted algorithms and yielded a mean kappa value of 0.569 and 0.600 across all subjects in Datasets 2a and 2b respectively

Facilitating motor imagery-based brain–computer interface for stroke patients using passive movement

Motor imagery-based brain–computer interface (MI-BCI) has been proposed as a rehabilitation tool to facilitate motor recovery in stroke. However, the calibration of a BCI system is a time-consuming and fatiguing process for stroke patients, which leaves reduced time for actual therapeutic interaction. Studies have shown that passive movement (PM) (i.e., the execution of a movement by an external agency without any voluntary motions) and motor imagery (MI) (i.e., the mental rehearsal of a movement without any activation of the muscles) induce similar EEG patterns over the motor cortex. Since performing PM is less fatiguing for the patients, this paper investigates the effectiveness of calibrating MI-BCIs from PM for stroke subjects in terms of classification accuracy. For this purpose, a new adaptive algorithm called filter bank data space adaptation (FB-DSA) is proposed. The FB-DSA algorithm linearly transforms the band-pass-filtered MI data such that the distribution difference between the MI and PM data is minimized. The effectiveness of the proposed algorithm is evaluated by an offline study on data collected from 16 healthy subjects and 6 stroke patients. The results show that the proposed FB-DSA algorithm significantly improved the classification accuracies of the PM and MI calibrated models (p < 0.05). According to the obtained classification accuracies, the PM calibrated models that were adapted using the proposed FB-DSA algorithm outperformed the MI calibrated models by an average of 2.3 and 4.5 % for the healthy and stroke subjects respectively. In addition, our results suggest that the disparity between MI and PM could be stronger in the stroke patients compared to the healthy subjects, and there would be thus an increased need to use the proposed FB-DSA algorithm in BCI-based stroke rehabilitation calibrated from PM

Spectrum and phase adaptive CCA for SSVEP-based brain computer interface

Among various brain activity patterns, Steady State Visual Evoked Potential (SSVEP) based Brain Computer Inter-face (BCI) requires the least training time while carrying the fastest information transfer rate, making it highly suitable for deploying efficient self-paced BCI systems. In this study, we propose a Spectrum and Phase Adaptive CCA (SPACCA) for subject-and device-specific SSVEP-based BCI. Cross subject heterogeneity of spectrum distribution is taken into consideration to improve the prediction accuracy. We design a library of phase shifting reference signals to accommodate subjective and device-related response time lag. With the flexible reference signal generating approach, the system can be optimized for any specific flickering source, include LED, computer screen and mobile devices. We evaluated the performance of SPACCA using three sets of data that use LED, computer screen and mobile device (tablet) as stimuli sources respectively. The first two data sets are publicly available whereas the third data set is collected in our BCI lab. Across different data sets, SPACCA consistently performs better than the baseline, i.e. standard CCA approach. Statistical test to compare the overall results across three data sets yield a p-value of 1.66e-6, implying the improvement is significant.Accepted versio

Modeling EEG-based motor imagery with session to session online adaptation

Subject-specific calibration plays an important role in electroencephalography (EEG)-based Brain-Computer Interface (BCI) for Motor Imagery (MI) detection. A calibration session is often introduced to build a subject specific model, which then can be deployed into BCI system for MI detection in the following rehabilitation sessions. The model is termed as a fixed calibration model. Progressive adaptive models can also be built by using data not only from calibration session, but also from available rehabilitation sessions. It was reported that the progressive adaptive model yielded significant improved MI detection compared to the fixed model in a retrospective clinical study. In this work, we deploy the progressive adaptation model in a BCI-based stroke rehabilitation system and bring it online. We dub this system nBETTER (Neurostyle Brain Exercise Therapy Towards Enhanced Recovery). A clinical trial using the nBETTER system was conducted to evaluate the performance of 11 stroke patients who underwent a calibration session followed by 18 rehabilitation sessions over 6 weeks. We conduct retrospective analysis to compare the performance of various modeling strategies: the fixed calibration model, the online progressive adaptation model and a light-weight adaptation model, where the second one is generated online by nBETTER system and the other two models are obtained retrospectively. The mean accuracy of the three models across 11 subjects are 68.17%, 74.04% and 74.53% respectively. Statistical test conducted on the three groups using ANOVA yields a p-value of 9.83-e06. The test result shows that the two adaptation models both have significant different mean from fixed mode. Hence our study confirmed the effectiveness of using the progressive adaptive model for EEGbased BCI to detect MI in an online setting.ASTAR (Agency for Sci., Tech. and Research, S’pore)Accepted versio

Augmenting cognitive processes in robot-assisted motor rehabilitation

Abstract — Cognitive processes, such as motor intention, at-tention, and higher level motivational states are important factors that govern motor performance and learning. Current robot-assisted rehabilitative programs focus only on the physical aspects of training. In this paper, we propose a framework for motor rehabilitation based on the augmentation of cognitive channels of patient-robot interactions and using it to deliver a more optimal therapy. By examining the cognitive processes involved in motor control and adaptation, it is argued that optimal therapy needs to be considered in the context of a complete motor scheme consisting not only of sensorimotor signals, but also their interactions with cognitive operations, such as motor planning, attention, and motivation, which mediate motor learning. We outline a few BCI-based modules for the detection and monitoring of relevant cognitive processes, which provide inputs for the robot to automatically modulate parameters of the rehabilitation protocol. Preliminary inves-tigations on a BCI module for detection of motor intention, performed on a small group of stroke patients, show feasible accuracies. I

A hierarchical dynamic Bayesian learning network for EMG-based early prediction of voluntary movement intention

Decoding human action intention prior to motion onset with surface electromyograms (sEMG) is an emerging neuroengineering topic with interesting clinical applications such as intelligent control of powered prosthesis/exoskeleton devices. Despite extensive prior works in the related fields, it remains a technical challenge due to considerable variability of complex multi-muscle activation patterns in terms of volatile spatio-temporal characteristics. To address this issue, we first hypothesize that the inherent variability of the idle state immediately preceding the motion initiation needs to be addressed explicitly. We therefore design a hierarchical dynamic Bayesian learning network model that integrates an array of Gaussian mixture model - hidden Markov models (GMM-HMMs), where each GMM-HMM learns the multi-sEMG processes either during the idle state, or during the motion initiation phase of a particular motion task. To test the hypothesis and evaluate the new learning network, we design and build a upper-limb sEMG-joystick motion study system, and collect data from 11 healthy volunteers. The data collection protocol adapted from the psychomotor vigilance task includes repeated and randomized binary hand motion tasks (push or pull) starting from either of two designated idle states: relaxed (with minimal muscle tones), or prepared (with muscle tones). We run a series of cross-validation tests to examine the performance of the method in comparison with the conventional techniques. The results suggest that the idle state recognition favors the dynamic Bayesian model over a static classification model. The results also show a statistically significant improvement in motion prediction accuracy by the proposed method (93.83±6.41%) in comparison with the conventional GMM-HMM method (89.71±8.98%) that does not explicitly account for the idle state. Moreover, we examine the progress of prediction accuracy over the course of motion initiation and identify the important hidden states that warrant future research.Agency for Science, Technology and Research (A*STAR)Published versionThis study was supported in part by the National Robotics Programme, Singapore under Grant No. 1922500046 and Grant No. M22NBK0074, and in part by the Science and Engineering Research Council, Agency of Science, Technology and Research, Singapore, through the National Robotics Programme under Grant No. 1922500054

Learning EEG-based spectral-spatial patterns for attention level measurement

Abstract — In our every day life, our brain is constantly processing information and paying attention, reacting accordingly, to all sorts of sensory inputs (auditory, visual, etc.). In some cases, there is a need to accurately measure a person’s level of attention to monitor a sportsman performance, to detect Attention Deficit Hyperactivity Disorder (ADHD) in children, to evaluate the effectiveness of neuro-feedback treatment, etc. In this paper we propose a novel approach to extract, select and learn spectral-spatial patterns from electroencephalogram (EEG) recordings. Our approach improves over prior-art methods that was, typically, only concerned with power of specific EEG rhythms from few individual channels. In this new approach, spectral-spatial features from multichannel EEG are extracted by a two filtering stages: a filter-bank (FB) and common spatial patterns (CSP) filters. The most important features are selected by a Mutual Information (MI) based feature selection procedure and then classified using Fisher linear discriminant (FLD). The outcome is a measure of the attention level. An experimental study was conducted with 5 healthy young male subjects with their EEG recorded in various attention and non-attention conditions (opened eyes, closed eyes, reading, counting, relaxing, etc.). EEGs were used to train and evaluate the model using 4x4fold cross-validation procedure. Results indicate that the new proposed approach outperforms the prior-art methods and can achieve up to 89.4 % classification accuracy rate (with an average improvement of up to 16%). We demonstrate its application with a two-players attention-based racing car computer game. I